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ABSTBACT 

Classroom behaviors from the Texas Junior. High School 
Study vere related to achievement using both class mea^s-and student 
scores within classes as the units of analysis. Behaviors . 
significantly related tor achievement at the class level of analysis 
were not related to achievement within the class »nd vice versa*y 
There was no clear pattern jtt significant relationships at the class 
level of analysis. Boweverf significant within-class relationships 
did form a pattern indicating that students Abo were not as ^ 
-successful academically as other students in the class with similar 
entering ability, tende^vto act* differently in the classroom and were 
treated differently by the teacher. Several *explcUia£ion*(Tet e Offered 
for ttis pattern of jfteacher- student interactions occurring yithin 
classes. b It was concluded that results obtained at one l*?ei of - , 

analysis cannot be •generalized to other levels. Therefore^ it is 
important ^hat multilevel classroom data be analyzed at both the 
class, and student within class levels to develop a more thorough 
uirder standing of the relation of classroom processes to student 
achievement. (Author) I 
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Abstract 

Classroom behaviors from the Texas'Junior High School Study were 
related 1 to achievement using both class means and student scores within 
classes as* the units ..of *nal*sis. Behaviors s i gni f i cant ly r e la t ed to. 
achievement at the class level of analysis were not' related to 
achievement within the class and vice versa. There Was no clear pattern- 

V 

of significant relationships at the class level of analysis. However, 
significant within-clasa relationships di4 form a pattern indicating 
that students who were not as Successful academically as other students 
in the class with similar entering ability, tended to act differently in 
the classroom and were treated differently by the teacher. Several 
explanations were offered for this pattern of teacher-student 
interactions occurring within classes. It was concluded that results 
obtained at one level of analysis cannot ^e generalized to other levels. 
Therefore, it is important that multilevel classroom data be analyzed at 
both the class and student within class levels to develop a more ^ 
thorough understanding "of the relation of classroom processes to student 
ach ievement . v 
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' Multilevel Analyses of Teacher-student Re lat ioash ips 
in Junior High Classrooms 
DWfcrmining the effects of educational processes on student learning 

■* 

has a major focus of educational research during the past decade. 

Much of this research has involved relating -Teacher behaviors that occur 
naturally in the classroom to student -achievement in an attempt to find 
behaviors that are effective in promoting student learning (Anderson, 
Evertson, ^Brophy, 1979; Evertson, Anderson, Anderson, & Brophy, 1980; 
Stallings, 1975; Good & Grouws, Note L). One of the more serious 
problems that has been encountered In this researctj/concer ns the 
inherent ma 1 1 i le ve 1 ^nat ur e ^jP&duc a t i ona 1 data. That is, student 
learning occurs in the context o'f a classroom and not as an isolated 
event. Accordingly, class means have most frequently been used as the 
units of analysis, even when the data have been collected on indiv.^ual 
students. Recently, however, Cronbach (Note 2)J Burstein (Note 3), and 
others have argued that relationships occurri qgaat the class level of 
analysis may ^>ot coincide with those occurring at the student level 
within classes. Discrepanc i es*\etween relationships at the two levels 
would be expec'ted for several reasons. 

First, an average class behavior may represent a different construct 
from an individual level behavior. For example, the average proportion 
of correct answers for a particular classroom provides information about 
'the teacher's policies with regard to' task difficulty.' That is, 
betwi^pn-c lass, di f f erences on this variable are related, at least 
partially, to .di f ferences in the difficulty level of the materials S 
teachers assign to students in their classes, rather than to overall 
differences between classes in student ability. However, at the student 
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level,' the number of questions a s/u^ent answers correctly also reveals 
something about the ability levd£>i the student. Therefore/ the 
meaning of the behaviors being^tudie^ may vary depending upon the unit 
of analysis. /j ' f - > • 

Second, s t udent -wi t h fife 1 as s analyses involve a comparison of 
relative differences oc/yrring within the .classroom on the behaviors of 
interest, with mean differences between classes removed. Therefore, a 

different type of /j^estion is addressed by wi thi n-ol ass analyses than 

// - 
that addressed hy/class level analyses. Again, this concept is probably 

best niustrafi^T with an example. It is possible to find no relation- 
ship be twee? A behavior such as criticism an* achievement at ttie class 
level but ^strong relationship within the class. Such results would 
suggest/£iat although the absolute amount of criticism a class receives 



is no//np)rtant, the way that crit-icism is allocated within the class 

s /^poriars. In" other words, tjie achievement of studants in a class 

receive more crit icism • re lat i ve to other students in the sane class 
* 

y be affected simp ] y because these student know that they received a 
greater amount than other class members. 

Other researchers have shown that the consideration of within-class 
or wi th i n-grpup analyses along w'ith class level analyses can be 
important in developing an understanding of the relationship between 
classroom behaviors and student achievement. Martin, Veldman, and 
Anderson (1980) investigated the relationship of certain classroom 

behaviors to achievement using several different levels of analysis. 

/ 

Their d$ta were collected on teacher-student interactions (^t occurred 
while first-grade students participated in reading groups within*, int act 
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classrooms. Thus* they were able to analyze their data .at three levels: 

class, reading-group-within-class, and s t ude n t-wi th i n-read i ng- grorup. 

They found many more significant relationships at the student levels 

# ~* 

within reading groups than at the "other levels, and attributed this 
primarily to the student s 1 awareness of their' t standi ng within the 
grouo. 

The purpose of the study reported here was to investigate both class 
level and wi thin-class level relationships between classroom penaviors 
and student achievement in seventh-* and' eighth -grade rat hi and English 



p r o v l d c . 



classes. It was exoe.'ed that withan-cTass' ana' v^; vow 

<■ 

obtained betw 



e^n classroom 



additional information ab :> j t relationships J 
beia/iors a°d student achievement. 

Met^cdolog ;. 

Over*/ i ev 

■ ^ i ■ • / ,v 

Data for this investigation csm° fr Dm* the Texas Junior High Sc^oo 1 ^ 

Stud-y, a large mult i faceted study designed to identify var i an 1 es^kia^ 
were related to affective and cognitive student outc ;mes in spr/eyth- and 
eighth-grade math and English classes. During the L974-L97j ^chool 
year, 58 math and 78 English c^ass^Pwere visited alterrfat^{y by two 
observers approximately 20 times, ach class,* L0/xo/l2 students were 

chosen randomly, within sex,* fcr intensive observatio/i and these 
students 1 interactions with the teacher were re/or/fed on a low inference 
observational coding system. 

The California Achievement Test (CAT) yvay given at the beginning *of 
the school year and was^ used as the prelesyt maasure. The posttests, 
given at the end of the school year,/we/e specially designed achievement 
tests in both math and English. 
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/ 

Other /data were also! collected but will not be discussed here. The 



/ 

/ 

J 

me 



i 



thodol^gy and results ^ this large study are completely described in 
Evertsoa et al. (1980). A 
Subjects *' ' 

s A* total of 68 teachers\ were observed in nine junior high schools 
that represented a wide rar\ge of socio-economic status levels in a large 

urban school district. Because two sections were* observed for e^ach 

\ 

teacher, there were 136 clashes in all, 58 math and 78 English. 
Teachers selected for the study had at least one year of previous 
experience teaching in thei'r subject matter area. ♦ 

The data set for the- analyses presented* in this paper differs in 
several ways from the original data set described above ^-i F i rs t , all 
students without both pre- and posttest scores were eliminated. Second, 
math classes containing fewer than six students anJ English classes 
containing fewer than seven students were dropped. Finally, two math 
and three English classes were dropped because their scores were so 
radical Ly different from other classes that they seriously a^ected the 
distribution and were considered outliers, i.e., atypical of ipath and 
English junior high classes included in this sample, ^ 

The original sample consisted of 58 math classes with a total of 705 
students and 78 English classes with a total of 9 5 L stcrdents, % The final 
data set consisted of 50 math and 55 English classes. Data were 
available for a total of 397 students in math classes and 456 students 
in English* classes with an average of eight students per class for both 
math and E,ngli s\fi 
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Data Collection 



Two observers were trained to use the observational coding system. 

The observers were trained to a reliability cri-terion of»80% agreement 

on each najor section of the coding system. Thereafter, observers 

worked alone. Observers alternated visits to classrooms so that each 
l 

6 

class was observed approximately 20 times throughout the school year. 

* 

Independent Variables ^ 

The variables reported here were chosen because they represented the 
four major commorients of an a'cademic interaction between the teacher and 
an indwicuai student: selection of the student, questioning by the 
teacher, the students' answer, and the teacher's response to the answer. 
Student ni sbenav i ors , froth disruptive and nond i sfunt i ve , were also 
included. \ , » * 

Proportion variables were created from* several categories of tne 

pbs2rvation syste^. Frequencies of single categories (e.g., the number 

of correct answers) were summed across all observations for the two 

i 

units of analysis (teachers and students). Then, the'se f requenc i es- we re 
used to create proportions representing actual occurrences compared to 
maximum possible occurrences (e.g., th? proportion of all answers that 
were correct answers). These proportion variables are listed in 
Tables 1 and 2 . " „ 

Data Analy ses 

Two sets of regression models were evaluated for each independent y 
^variable: one that used class means as the unit of analysis and ope 
that analyzed student scores within classes. In both sets of regression 
models, CAT scores were used as a covariable and achievement 'scores were 
used as the criterion. ' Data were analyzed separately for English and 

1 S - 
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for math-. At each of the two levels of analysis*, tests were * per formed 
to detect statistical interactions (i.e., the relationships between 
classroom behav io rs^»(f^ach^^emeat varied according %> entering 
ability) and main e f f ec t £ fN^ . > there was a linear relationship between 
cLassroon behaviors and /ohievement when entering CAT score was a 
cov.ar i ab le } . * 

The first seL of-models (shown below in abbreviated notation) 
contained class means as the' un.it of analysis. Predictors were the 
classroom behavior variable and the interaction of the behavior variable 
with CAT: 

ACHc = CATc + CBc + CATc*CBc + £■ 
where ACHc is the class mean achievement score (either matter 
Engli sh) , 

CATc is the class me a. on the California Achievement Test (for 
either math or English), 

C3c is the class mean on the behavior described by that variable, 

CAtc*C3c is the vector registering the interaction of CAT and 
classroom behavior, and 

Ec is the error term. ~ . 

. The second set of models contained student* scores as the uni^ of 

analysis." Predictors were the classroom behavior variable, the 

interaction of the behavior varfafrle with, CAT, and a set of binary 

vectors indicating class membership. Inclusion of the binary vectors in 

the* restricted models in wh i ch .CATs*CBs dhd then CBs were omitted had 

the effect of analyzing student scores within classes. 

ACHs = CATs + CBs + CATs*CBs + C I + C2 + . . . + CN + Es 

where CI, C2, etc., are binary class membership vectors. Other terms 
t 

t 
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correspond to the definitions given above, except that all entries were 
student scores. 

Results • % 

— * 

t • 

Significant main effects and interactions obtained- from the 

regression equations for b^th class level and s tudent-wi th i n-c las s~ leve I 
analyses are presented in Table I for math and Table 2 for English. 
Table 3 compares the average standard deviation of student scores for 
classes wffch the standard jdevi at ion of class means for both English and 
math. Significant results from the regression analyses are summarized 
below. 

Results from the two levels of analysis will be interpreted in 
different ways. When class means were the unit of analysis, relation- 
ships^ de sc r i bed- ways that mean behaviors, which differed between 
classes, related to differences in class mean achievement. In contrast, 
s tudent-vi thin-c lass analyses determined whether student scores on the 
behaviors were' related to student adjusted achievement. Because student, 
scores were compa red *wi th inl c las ses , relationships obtained in these 
analyses were relative. That is,- a positive relationship indicated that 
students receiving a higher amount of the behavior relative to other 
students in the same class achieved more, regardless of the actual 
amount of the behavior received by the students. 
Results of Math Class Level Analyses 

In math, four of tl^ 24 behaviors investigated in thj^s study were 

significantly related to achievement at the class level of analysis. 

The greater the number of call outs occurring in a class, the lower the 

class achievement. Within the c las s however , call outs were not 

< 

related to achievement. Hi gher * ab i I i t y classes achieved more and lower 
ability classes achieved less when correct answers were followed."^ 

10 ( ' 
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> a 

immediately by new questions from the teacher. The- proport ion of ' - 

correct answers followed by new questions was not related, to achievement 

within the class. 

When provided with more sustained feedback, higher* ability classes 

achieved more, tuft lower ability classes achieved slightly less. 

Sustaining feedback was not related to achievement within the class. 

Sustaining feedback was coded whenever the ^eacher tried to help a 

student figure out the correct answer by providing fc lues or repeating 
- t ■ 

ttf& question. * y 

And finally, with more nondisrupt ive misbehaviors, higher ability 

t 

classes achieved more and- lower ability classes achieved less. Within , 
-the— ^las-s ? - JiandisruiptLve hehaviors wer£ not related to achievement . 
Nondisrupt .i v#. misbehaviors were mild misbehaviors such as daydreami ng K 
wasting time, -and socializing th^t provoked a reaction from the 
te acher . . 

Results of M a t h_ With i n - c lass Analyses t * 

Only three of the £4 behaviors wer<f signi ficantly related td 

aAievement within math classes. None of these three behaviors were 

related to achievement at the class level of analysis. 

Within classes, students who failed to respond to teacher 'quest ions 



achieve^" less, students who more frequently sought out the teacher for 
academic help achieved more, and finally, students who either faired to 

\ • ; " 

respond or who said' they did not know the answer to a teacher quest ioa 

and were criticized by the teacher, achieved less. (This relationship 

wjis more pronounced for lower achieving students.) 

Results of English Class Level Analyses 
• — i 

i ' 

At the class level of analysis in English, three of the 24 behaviors 
were significantly related to achievement. Lower ability classes that 
received more profess (■fcfctions achieved more while higher ability 

■ - u . 



Multilevel Analyses 10 



classes ach ieved *les*s . There was no relationship between process 
questions and achievement within ^Jhe class. Process ques-fions were 



questions that* required students to explain how they derived their ^ • 
an swe r s . f ^ 

Call out s* were not related to achievement for higher ability classes 
but were negatively related to achievement for lower ability classes. 
As, in math classes*/ call' outs were not related to achievement within the 
class. 

Higher ability classes in which s t ude n t s . fa i led to^ respond or 
responded witjh "don't know" and were given sustaining feedback achieved % 
more,^while lower ability classes achieved less. Within the class, ?his 
variable was not related to achievement. ^ 

Results £>f English Within-class Analyses * * 

— 2 p I ^ j * 

Six behavioVs were significant." related to achievement within 
English classes. Witnin these classes, students who received more 
product questions achieved less. At the class leve'l, product questions 
were not related' to achievement. Prod uct -"que s t ion s were short-answer 
questions that allowed the teacher to provide .practice and to test 
student comprehension. , 

Within classes, students who had more teacher-init iated contacts 
achieved less. The number o^f t eacher- in i t i at ed contacts ,was not related 
to achievement at ^he class level of analysis. 

Within classes, students who received more academic contacts with 
proces s feedback ach i eyed less, while at the class lever* the number of 
academic contacts with proc ess " feedback was not related to achievement. 
Process feedback involved more detailed explanations by the teacher of 
the step*by step processes involved in attaining the correct answer. 
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Within* classes,* stjjdents who answered more questions incorrectly 
f * 
achieved less. The average number of incorrect" answers _was not reLated 

to achievement at the class .Level. y 

Within classes, higher ab i^y '.students who Wiled to respond 
achieved more and Lower abiLity students who failed to respond -achieved 
less. For math fa i lures to respond were negatively related -to achieve- 

r 

ment within classes regardLess of abiLity leveL. At the cLass letfel, 

i • • " A 

failures to respond were not reLated to achievement for either math or 
English. 



With in^^c lass , lower ability students who displayed more disruptive 

1 

behaviors achieved less but the achievement of higher ability students 



* 9 * 

was not affected*by disruptive behaviors. At the class level, disrup-t 
tive behaviors wer.e, not related to achievement. Disruptive behaviors 
were serious misbehaviors that disrupted the work of other students in 
the class, i ^ «f 

Discussion 

> i. 

There were 'few significant relationships between behaviors and 
achievement at the class level of analysis and those that were signifi- 
cant did not seem to fit together into any particular ern. inere 

/ 

fore, only behaviors signi'f icant ly. re lasted to ach i evetfi£ftt * in both 
English and math wilb be discussed. It should be tfoted that these 
behaviors were not related to achievement within f th,a class indicating 
that these class level relationships can only be explained in terms of 
events affecting the class as a. whole. '\ 

In math, the greater the number of call outs occurring in. a class, 
the lower^ class achievement. In English, however, call 'out severe 
negatively related to achievement ohly for lower ab i 1 i tf c las ses and 
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were unrelated to achievement for higher ability classes. Within 

classes, call oats were not related to achievement in either English or 

math. A -negative relationship between *call outs and achievement at the 

class level -has been found by other 'researchers (Anderson et al . , 1979). 

Possibly call outs, which are' gene r al 1 y discouraged by teachers, are 

indicative of management problems which, in'turn, have been linked to' 

lower achievement (Emmer & Evertson, Note 4;-Evertson, in -press). The 

absence of a negative relationship for hi ghe r ' ab i 1 i ty English classes i*s 

* 

di.ff'icult to explain. 

*• V , 

9 In ma Lh ,. the proportion of total response opportunities provided 

with sustaining feedback was positively related to "ach i evement, for 
higher ability classes but negatively related to achievement for lower 

ability classes': Similarly, h i ghe r * ab i 1 i ty English classes in»which 

i 

students failed to respor^ or responded vitjh "don't know" and were given 

sustaining feedback achieved more while lower ability cl.as^es achieved 
* v 

less. Within English or mdth classes, sustaining feedback giveji to f\ 1 



response ^A^inities or to "don't know" and f a i 1 i.res^to respond* was 

not re late^^^ach ievement . 

/n higher ability classes, the students may have the necessary 

skills and motivation to figure out the answer fairly quickly when given 

t 

more time or fcelp from the teacKer. In lower ability classes, however, 
students may remain '/stuck" for some time on a single question while the 
teacher tries to help the student figure out tfie correct answer. Mean- 
while, the rest of the class is left with nothing to do. Consequently, 
students may tend to engage in more disruptive and inappropriate 
behavior making it difficult for the teacher to regain the students 
attention when ready to mo\*e on to a new question. Also, if pacing is 



ERIC 
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'disrupted by forcing the class to wait idly while the teacher interacts 
* • 

with a single student, le6s academic material will be covered. 

# 

Significant wi th i*n-c I as«s relationships between behaviors and 

I • ♦ 

adjusted achievement did tend to form a consistent pattern; students 

/"■ 

who were not as successful academically as .other students with similar 



ERIC 



entering ability in the same class tended to act differently in the 
classropm and were treated differently by the teacher. This within- % 

« 

class pattern may be attributable to severaT factors. 

a 

First, students who more of ten^fai^^to* respond to teacher ques- . 

t~ions or who answered incor rec t l^,^ach ieved less. This seems reasonable 

as these students/behaviors (incorrect answers and failures to respond) 

can be considered symptoms of failure and he/tce, would be. expected to 

oc^ur more frequently for poorly achieving students. However, other 
t t 

teachet behaviors that were significantly related to adjusted achieve- 
ment within classes suggest that teachers may have" attempted to modify 
their behavior when dealing with ^ese poorly achieving students. 
Product questions, teacher acadeiric contacts, process feedback, and 
teacher criticism were negatively related to adjusted achievement. 
Possibly, teachers directed mor-e of these behaviors to students in their 
clashes who were having greater learning difficulties. That is, 



"A 

teachers possibly directed more short answer "product'! qGeS^pns to 

/ 

students who were either not paying attention or were most in need of 
drill and practice. Also, teachers probably contacted students in the 
class who were having academic' problems more frequently than other 
students, and when they did contact these students, they were probably 
more likely' to provide them with process feedback (step*by step 
explanations for how to arrive at the correct answer). Finally, it 
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• r 

4 

seems iikely that teachers, when they chose to u$e criticism, criticized 
those students'within 'their class who were not worly.ng up to their full 
potential. ' \ 

The behaviors discussed above, both teacher and student, were not 
si gni f ic ant ly re lat,ed to ach i evement^at the class level of analysis 
probably because class averages on the behaviors represent different 

constructs than do the individual level variables. Some teachers may 

* • + 

tend to use more of these behaviors and some may use less. Conse- 
quently, average Amounts of the behaviors foY each cj/ass may reveal more 
about the teacher's general method of instruction than about the 
achievement of~~TFie~"clas s as a whole. 

A second explanation for the pattern of significant within-class 
relationships^ involves awareness among students of their standing within 
the class. *The effect of within-class awareness on ad ; evement can best 
be illustrated by considering three of the significant within-class 
behaviors — incorrecft answers, failures to respond, and teacher 

'.criticism. A student's standing compared to o^ther students within the 

class on, these behaviors may influence the student f s academic self 
^concept,, that is, the student ! s perception of him/herself as a good or 
poor stuxdent. Students within a class. who most often fail to respond to 
t eacher , quest ions or respond incorrectly, or students who are criticized 
more than their' peers, may perceive themselves (and be perceived by 
other students in the* class) as the class "dummies. M These students 
may come to believe that they' have no control over their academic 

- achievement t^cause, : 'regard less of how hard they try, they are always 
less successful than the it* fel low c las smat es . Cooper ( 1979 ) , in 
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reviewing the expectancy Literature suggested that student motivation is 
adversely affected by such feelings of inefficacy. Accordingly, 
students who *re generally less successful than their peers may develop 
feelings of ineffic.acy which may lead to lessened motivation and V 

finally, to lower achievement. In this situation then, how often a 

* ' v * 

behavior occurs in a class is not so important as who, within that 

class, receives th^ behavior. 

..**••. * . ... 

\These wi^th in-c lass comparisons are probably less important in junior 
^igh than in" elementary' school (see 'Martin et a 1". , J 980)j_ Online ^ 
^.average, students spend slightly less than an hour ifl" any one cl\ss in 

junior high and therefore, a student's standing in that class is 

i 

probably not as important as in elementary school when 'the whole day may 

\ ' . , 

be spent in a single c las£#~^Al so , by the time s tudent s*>CT cH---4^ un ior 

high school they have many years of classroom- experience with which to- 

}udge Cheir present performance so that a student's standing in any 

particular class-for a. sHngle semester'or year may be, less important ^ 

than in earlier grades. Nonetheless, within-class comparisons may sjtill 

be a powerful force aff/cting student attitudes and subsequent 

-J 

achievement in junior high schools. 

i 

In summary, at the class level of analysis no clear pattern of 
significant relationships was found between behaviors and achievement. 



However, significant within-class relationships did form a pattern that 

indicated students who were not as sucessful academical Ly*as other 

• t 

students in the same class with similar entering ability tended to act 

differerjfly in the classroom and were treated differently by the 
teacher. Possible explanations were offered for this pattern of' 
teacher-s tudent interactions occurring within the class.: 
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Clearly, class level relationships betweenj behavi o rs and/achievement 
cannot be generalized to individual students within classj/ . Analyses 
at the class level address • d i f ferent questions than do ^tose at the 
^student within-class level. ^ That is, factors influenc/ing relations' 
at the class level may not operate at the student l^vel within^J: 
and vice versa. Therefore, when researchers are Confronted wi 
multilevel classroom data it is important that" the data be ar 
both the class and student within-class level^ to develop a 

. . / * 

-thorough- uoder-staadiag of the -xelat innship pi cl-assroQEL. 
student achievement. 
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Table I 

« 

Summary Table of Results For Math 

Class Student Within Class 



Teacher Behavior j x 
Teacher Questions: 

1. Process questions 

2. Product ^uesti^ns^ ^.82 

Teach'er Selection 
of Student sit 



R 2 Difference R 2 Difference 

for for 
Inter- Main Inter- Main 

SD action Effect x SD action Effect 



3. Who are 

nonv.olunteers 

<4. Who are 
* volunteers 



.49 



13 .Q031 .0094 .16 .13 .0000 .0001 
,13 .0009 .0148 .82 .14 .0001 .0002 



.24 .0043 .0008 .49 .19 ".-0009 .0004 



.24, .19 .0009 - .0177 .24 .16 .0004 .0000 



5. Student callouts 
in response to 
a teacher question .21 

Response Opportunities: 



.2 1 -.0068 .020K-) .21 .17 .0002 .0000 



6. With correct 
anavers , 

7. With incorrect 
answers 

%. 

8. With don't know 
answers 



.77 .15 .0013 .0136 .76 .16 .0004 .0004 



16 



14 .0019 .0047 .16 .12 .0002 .0002 



*:04^ .04 .0036 .0041' .04 .05 .0003 .0000 



9. With no Response 

answers / .04 

Correct Answers Followed By: 
10., Praise/ .12 
I I . New que s t ion .0 7 

Incorrect Answers Followed By: 
12. Cri/icism ,01 



.04 .0009 .0155 .04 .06 .001 1 .0057( -)* 

. 12 ^ .00 14 .0 140 .12 .1 1 .0005 .0015 

.08 .0242 * .0 1 10 - .07 .07 .0005 .'00103 

.04 .0035 .QU4 .01 ..03 .0000 .0023 - 
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Teacher Behavior 



Table 1-continued 

Class 

fR2 Difference 
for 

Inter- Main 
SD action Ef fee t 



Student 



7 



: N \j.thin 



Class 



R 2 Difference 
for 

Inter- Main 
x' SD action Effect 





13. 


Process feedback 


. 15 


.21 


.0097 


.0001 


. 15 


; 16 


.0002 


.000 I 






14. 
♦ 


Sustaining feedback 


.20 


.19 


i * 

.0012 


.0106 


.20 


.20 


.0003 


:0029 






Don't Know and" TTo 

Res ponae^Answers Followed By: 








» 












15. 


Cr i t i c i sm 


.05 


.17 


.0002 


.£037 


.05 


'.03 


y 0l04 


- .0002 






l^- 


Su s* a-in i ng feedback --- 


.-IS 


-.17- 


,0004- 


,0001- 










t 




All 


Response Opportunities 


Fo 1 lowed 


By: 












~> 




17. 


Praise 


.09 


.09 


.0031 " 


.0192 


.09 


.08 


.0008 


.0010 






18. 


Sustaining feedback 


. 10 


.08 


.0209 


.0025 


.10 ' 


.09 


..0000 


.0010 


V 




19. 


Process feedback 


.25 


.10 


.0000 


.0147 


.25 


.12 


.0001 


.0001 





Acado-nic Contacts: 
20. Student created 

2 I . Teachefr created 
t 

22. That were private 
Mi sbehav iors : 

23. Nond i sr^upt i ve 

24. Disruptive 



63 


.1 ♦ 


.0026 


.0122 


.62 


. 19 


.0000 


55 


.20 


*.0002 


.0007 


.55 


.25 
'.16 


.0002 


62 


4 3 


.0012 


-.0057 


.62 


.0000 



L 

.003K + ) 



.46 .22 .0^78 .0004 



.09 .08 .0 L*26 .0044 



.46 .27 .0003 
.09 .tl .000^ 



.0000 
.0023 

.0001 
.0004 



^'NOTE: Probability values are indicated by underlining: p < .05 where * 
one lin* appears; p < .01 where two lines appear. 
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Table 2 

m \ 

Summary Table of Results For English 
Class 




T eacher Behavior 
Teacher Questions: 

1. Process questions 

2. Product tjuestionc 

4 

9 

Teacher Selection 




R 2 Diffe rence 
or 

\ Inter-! Main 
SD action \ Effect 



Student Within-Class 
~" R 2 Di f ference 

for 

Inter- Main 
x SD action Effect 



.14 .14 .QLL4 .0000 
,79 . 15 .0000 .0001 



.14 .12 .0000 / .0002 
.79 . 16 \0000 J .0047(-) 



3 . Who are 
nonvolunteers 

4. Who. are 

vo 1 un teers 

5. .Student callouts 

in response to 

a teacher question 

Response Opportunities: 

6. With correct 
answers 

7. With incorrect 
answe rs 

8. With don ! t know 
answers 

9. With no response 
answers 



.48 .23 .0008 .0028 

.25 .22 .0035 .0001 

r 



.48 .20 .0002 .0000 

O 

.25 . 16 ' .0001 ■ .0002 



,12 .13 .0112 .0123, .12 .13 .0009 .0012 



.82 .11 .0030 .0013 



10 .07 .0000 .0001 



.82 .14 .0005 .0028 
.10 .10 .0003 .0052(->- 



.03 .04 .0046 ' .0026 .03 .05 .0002 - .0001 



.04 .06 .0026 
Correct Answers Followed By: 

10. Praise .U 

11. New question 
Incorrect Answers Followed fiy: 

12. Cfrj^ism .02. .07 '.00,34 



• {■ ■ 

12 .5(014 



.07 .08 .0019 
f ■ 



.0019 .OA .07 .0037 .0000 

'.0097 .12 .10 .0007 .0018 

.0000 V .07 .07 .0006 .0010 

.0010 .01 .02 .0000 .0009 ' 



ERIC 



23 



f. 



^Multilevel Analyses — 22 



Teacher Behavior 



L3. Process feedback 



X 

.'[5 



Table 2-continued 

Class 

R2 

Di f fer ence 
for 

Inter- Main 
' SD act ion Effect x 



Student Within Class 

' R 2 Di f ference 
for 

Inter- Main I 
SD act'ion Effect 



,26 .0008 .0049 



.14 .10 .0010- 



.000 L 



14^ Sustaining feedback 


.20 


. 19 


.0015 


.0000 ' 


.20 


.22 


0001 


, .0000 


Don't Know and No * 
Response Answers Followed By: 












s 




15. Criticism 


.05 


.16 


.0040 . 


.0055 


.05 


.04 - 


0003 


.0000 


16. Sustaining feedback 


.13 


,22 


.0L39 


.0000 ■ 


. 12 


.10 


.0073 


.0002 


All Response Opportunities 


Fo 1 lowed 


By: 












L 7 . P r aise \ 


.09 


. 10 


. 00 L L 


.0004 


.09 


.09 


.0010 


.0004 


18. Sustaining feedback 


.08 


.08 


.O0L7 


.0006 


.08 


.08 


0002 


.000L 


19 Process feedback 


.L4* 


.09 


.0037 


.0047 * 


. L4 


.to 


.0014 


.0038C-) 


Academic Contacts: 


















20. Student created 


.53 


.16 , 


.0007 


.0000 


.53 


.20 


.0002 


.0000 


21. Teacher created 


.50 


.20 


.0008 


.0000 


.50 


;2 3 


00L3 


~.0078(-) 


22. That were private 


.53 


. 15 


.0000 


.0003 


.53 


. L6 . 


.0003 


.0007 


Mi sbehavio r s : 


















23. Nond i sr upt i ve 


.39 


.15 


.0000 


.00.49 


.39 


.30 


.0QL0 


.00L6 v. 


24. Disruptive 


.07 


.07 


.0077 


.0027 


.07 


.09 


.0069 


.0043 

# 



NOTE: Probability values are indicated by underlining: _p < .05 where 
one '1 i ne~ > a I f>penr s ; p < .0*1 where two lines appear. 
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Table 3 ; 
Average Means and Standard' Deviations 
for CAT acfd Achievement Scores 



Engl ish^ 

St udent-wi th in-ciass 

Class 
Math 



Student 
C 1 ass 



-wi th in-c lass 

t 



Mean 



CAT . Ac h icemen t 



144.78 
144.78 



135.63 
-135.63 



158.02 
158.02 

43.74 
43.74 



Standard/ Deviation 2 



CAT 



tch i evement 



3S.84 
33.46 



27.08 
'24.60 



21.75 



19.53 

15.61 
15.65. 



All means were calculated by averaging class means 1 .* 
To obtain student-wi thirvc lass standard deviations, the standard 
deviations of student scores within each class were averaged across classes. To 
obtain class level standard deviations, the standard deviation of class means 
was calculated. - — k 
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